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IN THE CLAIMS : 

Delete claims 1-5 and replace with new claims 6-8 as shown in the attached 
Annexure A. 

REMARKS 

Item 3 of the Official Action has now been traversed. 

Items 4, 7, 8, 9,10 are now moot in view of the new claim 6. The invention relates to 
deblurring images in the "Artcam" type camera disclosed in the priority documents referred 
to on page 2 of the specification, that is, a camera system with an inbuilt Inkjet printer. 

The Applicant has taken the opportunity to re-cast the specification into a more appropriate 
format and a substitute specification is attached. A marked up copy of the substitute 
specification is also attached. At the same time US patent application numbers of the co- 
pending, cross-referenced application have been added. These numbers were not available 
at the time of filing the present application as the co-pending applications were filed 
contemporaneously with the present application. Further, the change of the charts from 
landscape view to portrait view has been made purely to make it easier to read the 
specification. 

The applicant respectively submits that no new matter has been added or claimed by the 
proposed amendments. 

In view of the foregoing it is respectfully contended that all claims now pending in the above 
identified patent application recite a novel and not obvious system which is patentably 
distinguishable over the prior art. Accordingly, withdrawal of the outstanding rejection and 
the allowance of all claims now pending are respectfully requested and earnestly solicited. 
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CONCLUSION 



It is respectfully submitted that all of the Examiner's objections have been successfully 
traversed. Accordingly, it is submitted that the application is now in condition for 
allowance. Reconsideration and allowance of the application is courteously solicited. 
Very respectfully. 
Applicant: / r ) 
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Email: 
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TITLE OF INVENTION 

"A DIGITAL CAMERA SYSTEM HAVING MOTION DEBLURRING MEANS' 



INVENTOR: RECEIVED 
KiaSilverbrook AUG 0 2 2001 

CROSS REFERENCES TO RELATED APPLICATIONS Technology Center 2600 

The following Australian provisional patent applications are hereby incorporated by cross- 
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STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 

Not applicable. 

FIELD OF THE INVENTION 

The present invention relates to digital image processing and in particular discloses A 
Camera System Having Motion Deblurring Means. 

Further the present invention relates to the field of digital image cameras and in particular 
discloses a camera system having motion blur compensating means. 
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BACKGROUND OF THE INVENTION 

Motion blur in the taking of images is a common significant problem. The motion blur 
normally occurs as a result of movement of the camera while taking the picture or otherwise as a 
result of movement of objects within an image. 

As a result of motion blur, it is often the case that the image taken is non optimal. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a camera system having the ability to 
overcome the effects of motion blur. 

In accordance with the first aspect of the present invention there is provided a camera 
system for outputting deblurred images, said system comprising; 

an image sensor for sensing an image; a velocity detection means for 
determining any motion of said image relative to an external environment and to produce a velocity 
output indicative thereof; a processor means interconnected to said image sensor and said velocity 
detection means and adapted to process said sensed image utilising the velocity output so as to 
deblurr said image and to output said deblurred image. 

Preferably, the camera system is connected to a printer means for immediate output of said 
deblurred image and is a portable handheld unit. The velocity detection means can comprise an 
accelerometer such as a micro-electro mechanical (MEMS) device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Notwithstanding any other forms which may fall within the scope of the present invention, 
preferred forms of the invention will now be described, by way of example only, with reference to 
the accompanying drawing in which: 

Fig. 1 illustrates a schematic implementation of the preferred embodiment. 

DESCRIPTION OF PREFERRED AND OTHER EMBODIMENTS 

The preferred embodiment is preferably implemented through suitable programming of a hand 
held camera device such as that described in Australian Provisional Patent Application No. P07991 
filed 15 July, 1997 entitled "Image Processing Method and Apparatus (ARTOl)", in addition to 
Australian Provisional Patent Application entitled "Image Processing Method and Apparatus 
(ARTOla)" filed concurrendy herewith by the present applicant, the content of which is hereby 
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specifically incorporated by cross reference. 

The aforementioned patent specifications disclose a camera system, hereinafter known as an 
"Artcam" type camera, wherein sensed images can be directly printed out by an internal Artcam 
portable camera unit. Further, the aforementioned specification discloses means and methods for 
performing various manipulations on images captured by the camera sensing device leading to the 
production of various effects in any output image. The manipulations are disclosed to be highly 
flexible in nature and can be implemented through the insertion into the Artcam of cards having 
encoded thereon various instructions for the manipulation of images, the cards hereinafter being 
known as "Artcards". The Artcam further has significant onboard processing power by an Artcam 
Central Processor unit (ACP) which is interconnected to a memory device for the storage of important 
data and images. 

In the preferred embodiment, the Artcam device is modified so as to include a two 
dimensional motion sensor. The motion sensor can comprise a small micro-electro mechanical 
system (MEMS) device or other suitable device i^&sl^ to detect motion in two axes. The motion )C 
sensor can be mounted on the camera device and its output monitored by the Artcam central 
processor device which is disclosed in the afore-mentioned patent specifications. 

Turning now to Fig. 1, there is illustrated a schematic of the preferred arrangement of the 
preferred embodiment. The accelerometer 1 outputs to the Artcam central processor 2 which also 
receives the blurred sensed image from the CCD device. The Artcam central processor 2 utilises 
the accelerometer readings so as to determine a likely angular velocity of the camera when the 
picture was taken. This velocity factor is then utilised by a suitably programmed Artcard processor 
2 to apply a deblurring function to the blurred sensed image 3 thereby outputting a deblurred output 
image 4. The programming of the Artcard processor 2 so as to perform the deblurring can utilise 
standard algorithms known to those skilled in the art of computer programming and digital image 
restoration. For example, reference is made to the "Selected Papers on Digital Image Restoration", 
M. Ibrahim Sezan, Editor, SPIE Milestone series, volume 74, and in particular the reprinted paper at 
pages 167-175 thereof. Further, simplified techniques are shown in the "Image Processing 
Handbook", second edition, by John C. Russ, published by CRC Press at pages 336-341 thereof. 

It would be therefore obvious to the person skilled in the art that many different techniques 
for motion blur removal can be utilised in the preferred embodiment. Additionally, other forms of 
motion sensors may be provided. Once the input image has been deblurred, the image is then 



ART34US annotated 



able to be printed out by the Artcam device in accordance with the techniques as discussed in the 
afore-mentioned patent specification. 

It would be appreciated by a person skilled in the art that numerous variations and/or 
modifications may be made to the present invention as shown in the specific embodiment without 
departing from the spirit or scope of the invention as broadly described. The present embodiment is, 
therefore, to be considered in all respects to be illustrative and not restrictive. 

Ink Jet Technologies 

The embodiments of the invention use an ink jet printer type device. Of course many different 
devices could be used. However presently popular ink jet printing technologies are unlikely to be 
suitable. 

The most significant problem with thermal ink jet is power consumption. This is 
approximately 100 times that required for high speed, and stems from the energy-inefficient means 
of drop ejection. This involves the rapid boiling of water to produce a vapor bubble which expels 
the ink. Water has a very high heat capacity, and must be superheated in thermal ink jet 
applications. This leads to an efficiency of around 0.02%, from electricity input to drop momentum 
(and increased surface area) out. 

The most significant problem with piezoelectric ink jet is size and cost. Piezoelectric 
crystals have a very small deflection at reasonable drive voltages, and therefore require a large area 
for each nozzle. Also, each piezoelectric actuator must be connected to its drive circuit on a separate 
substrate. This is not a significant problem at the current IjTOt of around 300 nozzles per print head, 
but is a major impediment to the fabrication of f>a^widc print heads with 19,200 nozzles. 

Ideally, the ink jet technologies used meet the stringent requirements of in-camera digital color 
printing and other high quality, high speed, low cost printing applications. To meet the requirements of 
digital photography, new Inkjet technologies have been created. The target features include: 

low power (less than 10 Watts) 

high resolution capabihty (1,600 dpi or more) 

photographic quality output 

low manufacturing cost 

small size (pagewidth times minimum cross section) 
high speed (< 2 seconds per page). 

All of these features can be met or exceeded by the ink jet systems described below with 
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differing levels of difficulty, ^different ink jet technologies have been developed by the Assignee to ^ 
give a wide range of choices for high volume manufacture. These technologies form^art of separate 
applications assigned to the present Assignee as set out in the table,^lrfo^\ ^/<tsE2<su? ^^j^^^-^^^^-'^-^^^S^ 

The ink jet designs shown here are suitable for a wide range of digital printing systems, from 
battery powered one-time use digital cameras, through to desktop and network printers, and through to 
commercial printing systems. 

For ease of manufacture using standard process equipment, the print head is designed to be a 
monolithic 0.5 micron CMOS chip with MEMS post processing. For color photographic applications, 
the print head is 100 mm long, with a width which depends upon the ink jet type. The smallest print 
head designed is U38, which is 0.35 mm wide, giving a chip area of 35 square nun. The print heads 
each contain 19,200 nozzles plus data and control circuitry. 

Ink is supplied to the back of the print head by injection molded plastic ink channels. The 
molding requires 50 micron features, which can be created using a lithographically micromachined 
insert in a standard injection molding tool. Ink flows through holes etched through the wafer to the 
nozzle chambers fabricated on the front surface of the wafer. The print head is connected to the camera 
circuitry by tape automated bonding. 



Tables of Drop-on-Demand Ink Jets 

Eleven important characteristics of the fundamental operation of individual Inkjet nozzles 
have been identified. These characteristics are largely orthogonal, and so can be elucidated as an 
eleven dimensional matrix. Most of the eleven axes of this matrix include entries developed by the 
present assignee. 

The following tables form the axes of an eleven dimensional table of Inkjet types. 
Actuator mechanism (18 types) 
Basic operation mode (7 types) 
Auxiliary mechanism (8 types) 

Actuator amplification or modification method (17 tj^es) 
Actuator motion (19 types) 
Nozzle refill method (4 types) 

Method of restricting back-flow through inlet (10 types) 
Nozzle clearing method (9 types) 
Nozzle plate construction (9 types) 
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Drop ejection direction (5 types) 
Ink type (7 types) 

The complete eleven dimensional table represented by these axes contains 36.9 billion 
possible configurations of ink jet nozzle. While not all of the possible combinations result in a 
viable ink jet technology, many million configurations are viable. It is clearly impractical to 
elucidate all of the possible configurations. Instead, certain ink jet types have been investigated in 
detail. These are designated UOl to IJ45 alto^e/^ -^cUiA^ u^c^^ <2^^q<l^ /^i^lac^uz^ 

Other Inkjet configurations can readily be derived from these .^examplesi by substituting 
alternative configurations along one or more of the 1 1 axes. Most of the UOl to n45 examples can 
be made into ink jet print heads with characteristics superior to any currentiy available ink jet 
technology. 

Where there are prior art examples known to the inventor, one or more of these examples are 
listed in the examples column of the tables below. The UOl to U45 series are also listed in the 
examples colunm. In some cases, a printer may be listed more than once in a table, where it shares 
characteristics with more than one entry. 

Suitable applications for the ink jet technologies include: Home printers. Office network 

printers, Short run digital printers. Commercial print systems. Fabric printers. Pocket printers, 

Internet WWW printers, Video printers. Medical imaging. Wide format printers. Notebook PC 

printers. Fax machines. Industrial printing systems, Photocopiers, Photographic minilabs etc. 

The information associated with the aforementioned 1 1 dimensional matrix are set out in the 
following tables. 
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Actuator mechanism (applied only to selected ink drops) 




Description 


Advantages 


Disadvantages 


Examples 


Thermal 


An electrothermal 


♦ Large force 


♦ High power 


♦ Canon Bubblejet 


bubble 


heater heats the ink to 


generated 


♦ Ink carrier 


1979 Endo et al GB 




above boiling point. 


♦ Simple 


limited to water 


patent 2,007,162 




transferring significant 


constmction 


♦ Low efficiency 


♦ Xerox heater-in- 




heat to the aqueous 


♦ No moving parts 


♦ High 


pi t 1990 Hawkins et 




ink. A bubble 


♦ Fast operation 


temperatures 


al USP 4,899,181 




nucleates and quickly 


♦ Small chip area 


required 


♦ Hewlett-Packard 




forms, expelling the 


required for actuator 


♦ High mechanical 


TU 1982 Vaught et 




ink. 




stress 


al USP 4,490,728 




The efficiency of the 




♦ Unusual 






process is low, with 




materials required 






typically less than 




♦ Large drive 






0.05% of the electrical 




transistors 






energy being 




♦ Cavitation causes 






transformed into 




actuator failure 






kinetic energy of the 




♦ Kogation reduces 






drop. 




bubble formation 
♦ Large print heads 
are difficult to 
fabricate 




Piezo- 


A piezoelectric crystal 


♦ Low power 


♦ Very large area 


♦ Kyser et al USP 


electric 


such as lead 


consumption 


required for actuator 


3,946,398 




lanthanum zirconate 


♦ Many ink types 


♦ Difficult to 


♦ Zoltan USP 




(PZT) is electrically 


can be used 


integrate with 


3,683,212 




activated, and either 


♦ Fast operation 


electronics 


♦ 1973 Stemme 




expands, shears, or 


♦ High efficiency 


♦ High voltage 


USP 3,747,120 




bends to apply 




drive transistors 


♦ Epson Stylus 




pressure to the ink. 




required 


♦ Tektronix 




ejecting drops. 




♦ Full pagewidth 
print heads 
impractical due to 
actuator size 

♦ Requires 
electrical poling in 
high field strengths 
during manufacture 


♦ IJ04 
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